Modeling Dynamics of Information Networks 
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We propose an information-based model for network dynamics in which imperfect information 
leads to networks where the different vertices have widely different number of edges to other vertices, 
and where the topology has hierarchical features. The possibility to observe scale free networks is 
linked to a minimally connected system where hubs remain dynamic. 
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Complex adaptive systems can often be visualized as 
networks in which each element is represented by a ver- 
tex (node), and its interactions by edges (links) to other 
vertices. Network studies have been inspired by the ob- 
servation that working networks often have a broad dis- 
tribution of edges and possibly even scale free as reported 
for the Internet 0,12)111, anc ^ some molecular networks 
0- Further, real world networks often exhibit non ran- 
dom topological features. This may be modular 
hierarchical or other features that e.g. may help 
specificity in signaling [Tof . 

Most networks are the result of a dynamical process. 
One hypothesis is preferential growth that predicts scale 
free networks [ill Il2l HH ]. The preferential growth is 
however questionable in many networks, whereas trans- 
mission of information plays a fundamental role in nearly 
all networks, including neural networks with synaptic 
rewiring [lij . molecular networks, and social networks 
[lj |. exemplified by the Internet 0, H El E3 In fact, 
networks may be viewed as the natural embedding of a 
world with a limited information horizon. Thus, it is 
interesting to explore a network topology that is dynam- 
ically coupled to information transmission and formed in 
an ongoing competition for edges between a fixed num- 
ber of vertices. We will suggest that a broad range of 
vertex degrees could be understood not as an extension 
of the narrow distributions of the Erdos-Renyi networks 
(l4|. but rather as the result of an intrinsic instability of 
a centralized system illustrated in Fig. ^ 

We consider a dynamic network where each vertex at- 
tempts to optimize its position, given limited informa- 
tion. A natural quantity to optimize is the participation 
in the activities on the network. In economic terms this 
corresponds to optimization of trading activity Ei, or to 
maximization of access to a variety of different products. 
One activity related measure would be the "betweenness" 
discussed by ■ Another measure is vertex-vertex dis- 
tances, and accordingly any vertex would attempt to 
place itself close to all other vertices. The globally opti- 
mized network is then the hub like structure |2l| , shown 
in left panel of Fig.^ The distances between vertices are 
minimal and can only be minimized further by adding ad- 
ditional edges between vertices on the periphery of the 
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FIG. 1: In a perfect world, a single vertex that can differen- 
tiate all exit edges from each other might distribute all tasks 
and information efficiently. In real world networks, no perfect 
"distributor" exists: even when every vertex "tries" to mini- 
mize its distances to all other vertices, typical vertices tend to 
connect through more than one intermediate. Imperfections 
destabilize the central hub, and the vertices in the network 
obtain a wide range of vertex degrees. 



central hub. The addition of such extra edges is not cost 
free, as any edge puts a cost to the system. We primar- 
ily consider a dynamics constrained by having the total 
number of edges (and vertices) conserved. 

In practice each vertex may have only limited informa- 
tion about the location of other vertices. When changing 
their neighbors by moving edges from one vertex to an- 
other, they may make mistakes due to their limited local 
information. This will destabilize the optimal topology 
with a central hub and may lead to a distributed network 
as shown in right panel of Fig. 

To study the interplay between information exchange 
and dynamical rewiring of edges in a network, we intro- 
duce a simple agent based model where different agents 
have different and adjustable memories in a way reminis- 
cent of the trading model in EH- Every agent, named 
by a number i = 1, 2, 3 ... n, is a vertex in a connected 
network that consists of N vertices and E edges. Agent 
i has a memory 



Mi 



A(0 

m) 



l = 1,2,.. 



M + l, 



■ N, 



with N — 1 distances D and pointers P to the other 
agents in the network. The distance Di(l) is agent i's 
estimated shortest path length to I. The pointer Pi{l) 
is agent i's nearest neighbor on the estimated shortest 
path to Thus Mj may be seen as a simplified version 
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FIG. 2: Dynamics of edge rewiring: The edge between i and 
j is rewired to an edge between i and k, if local information 
predicts that k provides a shorter path to the random agent I 
(I — £3 in figure). The agents' information about the network 
is subsequently updated as shown by the shift from lower left 
to lower right panel. Notice that the local information not 
necessarily is correct. 

of the gateway protocol used by the autonomous systems 
to direct transmission of E-mails across the hardwired 
Internet. Here, however, the memory will be used to 
rewire edges in the network. 

Initially the network is a hub of the N — 1 agents con- 
nected to a center agent by N — 1 edges (as in Fig. 2] left) 
plus E — N + 1 randomly placed edges on the periphery 
of the hub. The basic move, illustrated in Fig.|3 consists 
of a rewiring attempt plus some information exchange in 
a local region of the network. In detail the move consists 
of three steps: 

(i) An agent i and one of its neighbors j is chosen 
randomly. 

(ii) An agent I ^ i, j is chosen randomly and if 
Di(l) > Dj(l) then the edge between i and j is 
rewired to an edge between i and k = Pj(l)- If 
I did not satisfy the above criteria a new / is ran- 
domly chosen. If no such I exists the rewiring is 
aborted. 

(iii) The information i has lost by disconnecting j 
is replaced by information from k. Further, there 
is full exchange of information between i and k: If 
agent k lists a shorter path to some other agents, 
then i adopts this path with a pointer to k. Sim- 
ilarly for fc, if agent i lists a shorter path then k 
adopts this path through i. The information j has 
lost by disconnecting i is replaced by forcing agent 
j to change all its previous pointers toward i to 
pointers toward k and add 1 to the corresponding 
distances. 

Notice that above there is no information transfer be- 
tween j and k: j does not read any of A:'s information, 



j is only using the information that the rewiring took 
place. The model defines an update of both the network 
(ii) and the information that agents in the network have 
about each other's locations (iii). The step (ii) repre- 
sents local optimization where agent i rewires from j to 
k with a probability given by the fraction of the network 
which is estimated to be closer to the center. We stress 
that only a small part of the system is informed about a 
changed geometry and that decisions on moves may be 
based on outdated information. When repeated many 
times the model leads to a break down of the central hub 
into a steady state ensemble of networks with a broad 
distribution of vertex degrees. 

Fig. |3b shows that the degree distribution for vertices 
in the network is broad, in fact close to the Zipf law 1 /C 2 
reported for some real world networks as well as for 

the size distributions of industrial companies . How- 
ever, there is correction to scaling at intermediate and 
large vertex degrees. This limitation of the model can be 
removed by increasing the information between agents 
during the rewiring, for example by adding information 
exchange between agent j and agent k in Fig. [21 

(iv) j considers a fraction S of the information it 
has stored with a pointer toward k. For this frac- 
tion it is checked whether k lists a shorter path 
than j. For each path where this is the case, the 
memory of k is used to update the memory of j. 

Notice again that the update in (iv) takes place no 
matter which agent had the right data. When S = the 
result is as in the simple model (i— iii) , whereas S = 1 
leads to a hub like structure illustrated with the isolated 
distribution of highly connected vertices in Fig. [^i. In 
between there is a critical value of S = S cr n ~ 0.1 (for 
(C) = 3) where one obtains a scale free distribution of 
vertex degree (Fig.Et). S cr i t depends on the overall edge 
density in the system, and increases as the average degree 
(C) increases. Decreasing (C) below 2.9 even S = 
becomes super critical and the central hub of a big system 
[N » 100) will never break down. Oppositely, it is 
remarkable that an increase in C for fixed S makes it 
increasingly difficult to obtain vertices with very high C. 
In any case, at conditions when one hub dominates the 
topology, the hub becomes frozen and will never break 
down. Clearly, a scale free degree distribution requires an 
instability and the possibility for vertices to change status 
dynamically. On the other hand, when the instability 
becomes too large, no large hubs develop and the degree 
distribution becomes exponential. 

For simplicity we in Fig. 14151 consider the case of 
N=1000, E=1500, and thus (C) = 2E/N = 3 with 
S = S cr it = 0.1. We stress that the reported results 
are similar for other values of (C), provided that S is not 
too far from S crit {C). E.g. S crlt ((C) = 2.5) = and 
S cr it((C) — 5) = 0.45. Also it is important to stress that 
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FIG. 3: Left panel: Vertex degree distribution of the evolved network with 4 levels of information exchange: no exchange, i.e. 
only rules (i) and (ii) apply in a), full exchange as in (iii) with exchange of rate S in (iv) with S = 0, S = 0.1, and S = 1.0 
in b)-d). In all lower cases we sample dynamics of an N — 1000 vertex system with E = 1500 edges ((C) = 3). The plots 
show average of many samples. The upper graphs show the corresponding networks of size N = 100. Right panel: Schematic 
phase diagram illustrating the critical line which separates the dynamic and non-dynamic regime. The information exchange 
at levels a)-d) from left panel in e) and the variation of (C) that drives the network towards the critical line in f). 



the particular choice of rewiring attempt and informa- 
tion exchange in the above model is somewhat arbitrary. 
Therefore we have tested robustness of the obtained re- 
sults against a number of variations, including selection 
of agent i with weight proportional to its degree, abort- 
ing step (ii) after only one attempted I, and introducing 
information exchange between i and j . In all cases we are 
able to reproduce the qualitative features of Fig. 13151 In 
particular, a higher overall edge density always requires a 
higher information exchange to obtain similar large hubs, 
as illustrated in Fig. For any amount of information 
exchange a scale free network is obtained for the minimal 
(C) where the hubs remain dynamic (Fig. Ef). 

Figure 01 shows a) the average information content re- 
lated to agents of vertex degree C and b) the temporal de- 
velopment of one particular agent. In both panels, I f(i) 
is the fraction of the information i has about distances 
and directions to all other agents that is correct. Infor- 
mation I a bout{i) is defined as the fraction of other agents 
that have correct information about their paths to i. The 
upper curve in Fig. shows that the system systemat- 
ically increases the I a bout(i) as the vertex degree of i is 
increased. More surprisingly is the non monotonous be- 
havior of I f(i): Agents with intermediate vertex degree 
C know the least about the system. They are messed up 
by false information about directions, whereas the lowly 
connected agents are better informed through their typ- 
ically higher connected neighbor. 

Figure 0Jd follows a particular agent through a period 
of success, where it evolves to become one of the major 
hubs in the system. The figure shows both the degree of 
the agent, and the information related to it. Notice that 
an initially moderate increase in degree C at time ~ 500 




FIG. 4: a) Average information related to agents with vertex 
degree C for a simulation with critical information exchange. 
The upper curve is the fraction of agents with correct informa- 
tion Iabout about their paths to the specific agent of degree 
C. The lower curve similarly refers to the information I Q f 
the agent with degree C has about paths to other agents, 
b) Trajectory for a specific agent with its vertex degree (dark 
shaded area), the information the system has about the agent, 
Iabout, and the information the agent has about the system, 
Iof- Time is counted as number of rewiring updates per agent. 



triggers an increase in I a bout and a sharp decrease in I a f. 
Subsequent increases in C have little effect on the near 
perfect information that the system has about the agent, 
but a roughly proportional effect on the quality of the 
information I f . Thus the trajectory of a particular agent 
again reflects the ease at which one may locate anybody 
in or above the " middle class" , and the exclusiveness of 
having system- wide correct information. 

To explore the connectivity pattern between low and 
high connected agents, we in Fig.[S]investigate the corre- 
lation profile of the evolved network 01 ■ This quantifies 
the tendency of agents with different vertex degrees to 
connect to each other, by normalizing to a randomized 
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FIG. 5: Correlation profile for an ensemble of model networks 
with (C) = 3. The correlation profile measures the probabil- 
ity for an edge between two vertices of degree Co and Ci in 
units of what it would be in a properly randomized network. 
One notices that agents with C ~ 1 often connect to agents 
with C ~ 5 that preferentially connect to agents with high C. 
Thus the network exhibits hierarchical features. 



in an unstructured system. For example P c = 1 — C%/Ci, 
where C% and C2 are the highest and next highest degree 
in the network, results in a system that self organizes 
around the critical line as shown in Fig. 

The present work suggests a dynamical model where 
networks with both small and large hubs emerge from 
local optimization of activity through guesses based on 
imperfect information. The frame is formulated in an 
agent based model, which is comparable to a sociolog- 
ical setting. For static snapshots the model predicts a 
hierarchical organization of vertices with the highly con- 
nected vertices in the center. This is a plausible feature 
of business networks and a quantifiable characteristic of 
the hardwired Internet || . 

We warmly thank Petter Minnhagen and Ala Trusina 
for stimulating discussions. 



network where degrees of all vertices are exactly main- 
tained @- We see that all types of connections exist, but 
also that there is a tendency towards hierarchical organi- 
zation: Agents with C ~ 1 often connect to agents with 
degree C ~ 5, that preferentially connect to agents with 
very high C . This hierarchical pattern is also seen at 
other values of (C), with decreased amplitude as (C) is 
increased. Going in the opposite direction, towards de- 
creasing (C), our standard model quickly becomes super 
critical even for 5 = 0. This can be adjusted by decreas- 
ing the information transfer between i and k in step (iii) 
such that this transfer is less than complete. 

It is interesting to explore the sociological implications 
of the proposed network dynamics, e.g. the response to 
increased information associated to a particular agent. If 
we start with an agent of degree C = 1 and from this 
instant keep it perfectly informed about the position of 
all other agents, I f{i) = 1; the result is insignificant. 
Similarly, when an agent constantly broadcasts its cor- 
rect position to all other agents, that is I a bout(i) — 1, the 
agent only performs slightly better than average. How- 
ever, an agent that allows all its neighbors to update 
their information by using his information, very quickly 
becomes a central hub in the system. This happens in 
spite of the fact that his information may be as bad as 
that of anybody else. Communication, not correctness, 
is the key to success. 

Finally we reiterate that the critical line in Fig. |3f cor- 
responds to the minimal (C) where the major hub re- 
mains dynamic. This suggests a principle in which the 
network could self organize to become scale free. This 
idea is investigated by allowing agents, at a low rate, to 
create and destroy edges with probabilities P c and 1 — P c , 
dependent on the dominance of the major hub. That is, 
we set P c to be an increasing function of the dominance 
of the largest hub, reflecting a situation where links are 
created in a persistently centralized system and removed 
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